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(54) Display systems for operation by 
persons of limited controllable mobility 

(57) An operator-controlled display 
system, particularly for disabled 
persons, comprises a plurality of 
electrical switches, the actuating 
elements of which are closely grouped 
in a pattern so that the switches may be 
operated, e.g. by the user's tongue, 
either singly or in selected 
combinations. The switches control a 
visual display through an interface and 
a microcomputer, operation of a 
particular switch or combination of 
switches producing an effect in a 
portion of the visual display, the 
position of which effect is related to the 
position of the switch or switches in the 
aforesaid pattern. The user may thus 
select a particular area or point on the 
display by operating the appropriate 
switches. 
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The drawing(s) originally filed was (were) informal and the print here reproduced is taken from a later filed formal copy. 
The claims were filed later than the filing date within the period prescribed by Rule 25(1 ) of the Patents Rules 1982. 
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SPECIFICATION 

Improvements in or relating to display systems for operation by persons of limited controllable mobility 

5 The invention relates to display systems for operation by persons of limited controllable mobility, and 5 
particularly for operation by physically disabled people. 

Systems are known for enabling disabled people to communicate and/or carry out operations, wherein a 
visual display sets out an array of options and the operator controls selection of a particular option by 
controlling movement of an indicator, such as a cursor, over the array. In a common system for 

10 communication the visual display includes a list of messages which are illuminated or otherwise indicated in 10 
sequence and the operator selects a particular message by moving an indicator step-by-step until it reaches 
that message. Reaching of the message by the indicator may also be arranged to operate, or enable 
operation of, an operating mechanism with which the message is associated. For example, if the message 
reads "switch on light", this may either be a simple request to another person to carry out the operation 

15 required, or selection of the operation on the display may actually be arranged to switch on the light. 15 
However, such known arrangements suffer from the disadvantage that, in practice, only a limited number 
of predetermined options may be permitted, and the system does not allow the user to communicate on a 
subject not provided for by the predetermined messages. 
Alternative arrangements have therefore been proposed for enabling a disabled person to operate a 

20 keyboard, such as a typewriter or microcomputer keyboard, in order to widen the range of communication. 20 
However, the systems for operating the keyboard are elaborate and laborious to operate and may still be 
beyond the capabilities of certain classes of disabled person. This is due to the necessity of, through some 
sort of control system, actuating a different key of the keyboard for each letter or symbol to appear on the 
screen or paper. The present invention sets out to provide an improved operator-controlled display system 

25 suitable for operation, without considerable effort, by persons of limited controllable mobility, such as 25 
disabled persons. 

According to the invention there is provided an operator-controlled display system comprising a plurality 
of electrical switches, the actuating elements of which are closely grouped in a pattern so that the switches 
may be operated either singly or in selected combinations, and an electrically actuated visual display 
30 controlled by said switches in such manner that the operation of a particular switch or combination of 30 
switches produces an effect in a portion of the visual display, the position of which effect is related to the 
position of the switch or switches in the aforesaid pattern. 

p re f era bty the switches are closely grouped in such manner that they may be operated by the tongue of 
the operator. 

35 Since the effect on the visual display is related to the positions of the switches, any part of the display may 35 
be selected at will by the operator by actuation of the appropriate switches, without the necessity of moving 
a cursor or other indicator across all parts of the screen in succession until the required position is reached. 

Preferably the switches are coupled to the visual display through a microcomputer which is programmed 
to control the visual display in accordance with the operation of the switches. 

40 Preferably there is direct correspondence between the position, in the pattern of switches, of the switch or 40 
switches operated and the position on the visual display of the visual effect of such operation. 

The visual display may comprise a main array of items of information, so that a single item may be 
selected from the array by operation of one or more appropriate switches, the item, when selected, being 
visually indicated on the display, for example by blanking out non-selected items. Each item in the main 

45 array may comprise a sub-array of further items of information, the arrangement of items in each sub-array 45 
corresponding to the arrangement of items in the main array, such that, once a sub-array has been selected, 
further operation of one or more switches selects an item in the selected sub-array in accordance with the 
position of the switch or switches operated. 
There may thus be provided a plurality of levels of sub-arrays and, under microcomputer control, there is 

50 virtually no limit to the total number of items from which selection can be made by having sufficient levels of 
sub-arrays. All the items of information may be displayed on the visual display initially and the selection 
made by selecting successively smaller areas of the main array. Alternatively, once a sub-array has been 
selected it may be enlarged to take over substantially the whole of the visual display so that the next 
sub-array within it may be selected. 

55 The microcomputer may be programmed to control operations other than the aforesaid effects on the 55 
visual display upon operation of certain of said switches or combinations thereof. For example, operation of 
a switch or a combination of switches may be arranged to produce an effect on the visual display which is 
dependent on which particular item was previously selected from the aforesaid arrays. For example, where 
each item consists of a letter of the alphabet or other symbol, the arrangement may be such that once a 

60 particular letter or symbol has been selected a further switch operation prints the letter or symbol at a 60 
required position on the visual display and/or a hard copy print-out. 

Alternatively or additionally, the microcomputer may be interfaced with external operating devices which 
are controlled by operation of a switch or a combination of switches, the nature of the control being 
dependent on the item previously selected by the operator from the visual display. For example, the item in 

65 the array on the visual display may comprise the alternative positions of a steering member on a wheelchair 65 



50 
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so that once a particular desired position has been selected visually further switch operation actually carries 
out the selected steering movement. It will be appreciated that this is applicable to virtually any type of 



10 



15 



20 



control for any type of electrically operated device. ....... 

Althoughtheswitchassemblymaybeofanysu^ 
ooerator it is particularly desirable, as mentioned above, that the switch assembly may be operated by the S 
tongue^oft^ 

Tot i °suck/biow switch operated through a plastics tube, but this has the disadvantage that «s slow and 
can cause hyperventilation and it is also difficulty control a plurality of switches by th.s method. There are 
so sw tS located within the user's mouth behind the teeth in the upper palate. Such a sw.teh 
Sow^e haSSsadvantagethatitcanbeuncomfortaW ™ 
Xcordrngly,the present invention also sets out to provide, in another aspect thereof ^ improved form of 
swfeh assembly wnich is particularly suitable for use with the display system referred to above, but wh.ch ,s 

a S^SX2*SuSm* mounted on a support and with the actuating elements thereof c osely grouped 1 5 
?n a oattern the support being mounted on a carrier whereby the switch assembly may be supported 
exteS onhe mou?h of the operator and thus operated by protrusion of the tongue from the mouth. 
^^Kn^adap^ltormoumlnBonthe body of the user in a mannerto hold the sw.tch assembly 

■t^JSZS^moi. convenientand more comfortable to use than known arrangements since 20 
the switcS Si b. readily displaced from the user's mouth when not required and the user may 
IS^^SIIS^^ the assembly. Furthermore, the grouping of a plurality of m.crosw.tches allows 
onpratinnof adisDlavsvstemof the kind referred to above. 
The^ 

25 made to the accompanying drawings in which: 

Figure 1 shows diagrammatically a microswitch suitable for use in the invention. 
Figures 2 to 4 show the switch assemblies incorporating such microswitches, 
Figure 5 is a diagrammatic representation of a display system according to the invention, 
^rLetoSrepresentviewl -of oneform of visual display at different stages dunng operation of the 

30 ■yMm^and . representation of an alternative form of system. 

Figure 1 shows a basic type of known microswitch suitable for use in a tongue sw.tch according o the 
invention. The microswitch comprises a main body 1 0 on which is mounted an angled lever arm 1 1 wh.ch 
STa Plunger 12. Asmall plasticsroller13ismountedonthefreeextrem.tyofthelever11. 

35 Sring o Figure 2, to provide the tongue-operated switch unit a plurality of microswitches such as 14 
and iraemounted within a plastics casing 16, the main bodies of the microswitches being angled w, h.n 
the casing so that the lever arms on the two switches are brought into line and the rollers 17 and 18 of the 

fourmlcro^ches within the casing, the operating rollers 17, 18, 19 and 20 of the microswitches being 



25 



30 



40 

grouped together. 



Twm be appreciated that any other suitable number of microswitches may be mounted withm the ^asing 
provided that their operating rollers are grouped sufficiently close together ,n a patter as ; to enable the 
switches to be operated separately or in various combinations by the tongue of the opera on 
45 ft is found in practice that the distance between adjacent rollers should be approximately 0.75 cm to allow 
the tongue to press the microswitches singly or in combinations of two. M ^ mt tKo mn , lth 

To support the switch unit, the casing 16 is mounted on a carrier which locates the unit adjacent the , mouth 
of tne operator so that the switches may be operated by protruding the tongue sl.ghtiy ^om the m outh and 
engaging the appropriate switch or combination of switches. For example, the sw.tch un.t may °e mounted 
SO on a f ramework mounted on a fixed structure adjacent the operator's position on some component which 

50 moves wSe Operator, such as a headpiece, helmet, or movable chair. "*™^^« ame ™ V be 
•sunnorted on the shoulders and/or torso of the user in the manner of a mouth-organ holder. 

TBSShSi Ttofgue swrtch described above may be used to control any sort of elctrically actuated dev.ce. 
it is particularly suitable for use in a display system of the kind previously referred to and such a display 

cr svstem will now be described in greater detail by way of example. 

55 SReS to Figure 5, the switch unit 21 is connected via a computer input interface 22 to * >"»™» uMr 
or logic army 23 which is connected to a visual display 24 and may also be connected through arv output 
interface 25 to other devices to be controlled. The switch unit 21 is preferably a tongue-operated switch unrt 
of '£e ^Snfdescribed in relation to Figures 1 to 4 and having any suitable number of miwjjjj-f 
60 although.dependingonthedisabilityorotherrequirementsoftheuser,otherformsofsw,tchun.tcouldbe 

usedsuchasswitchunitsoperatedbythefingersorotherlimbsoftheuser. u:^^, tanaB 

TSeTnput interface 22 preLabiy contains 
However, in a system of this kind it is also possible to use very low voltage devices throughout 

The computer or logic array 23 may be a commercially available microcomputer but could also be a 
65 purpose built hard-wired logic array. 
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L>The visual display 24 would normally be a cathode ray screen but could also be an LCD or LED display or a 
so called "head-up" display whereby the information is reflected from a transparent screen. The devices 
controlled by the output interface 25 may be of any kind, such as a printer, radio, light or head-up display. As 
previously mentioned, 1 ^ switches in the switch unit 21 have their actuating elements closely grouped in a 
5 predetermined pattern and the computer 23 is so programmed that information is displayed on the screen in 
a configuration corresponding generally to the pattern of switches so that different portions of the display 
may be selected by operation of the appropriate switches or combinations of swttches^-i 

By way of example only there will now be described an arrangement for typing to the screen characters 
selected from 64 possible characters, using a tongue switch of the kind shown in Figure 4 incorporating four 

10 microswitches. . , . ...... + f 

UkFigure 6 shows the initial display on a portion of the T.V. screen, the display be i pg rii v iripri i nt o fni ir 
quadrants 26, 2 7, 28 and 29, each q uadra ot.including.a.sub,^ 

^SSSnSS^ to select, s -aVihi character "K" he first selects the upper left-hand quadrant 26 containing 
this character by operating the upper left-hand switch 17 of the tongue switch shown in Figure 4. The 

1 5 computer may be programmed so as then to blank but the unselected quadrants or, possibly, to highlight or 
otherwise indicate the selected quadrant.ln the former case the screen display is then as shown in Figure 7. 
The quadrant 26 is sub-divided (in.a manner which may or may not be indicated on the screen, as required) 
into four sub-quadrants 30, 31 , 32 and 33. The sub-quadrant containing the required character K , that is the 
upper right-hand quadrant 31 , is selected by a second key stroke, operating the upper right-hand 

20 microswitch 18. The appearance of the screen is then as shown in Figure 8. The sub-quad rant 31 is divided 
into fourfurther sub-quadrants 32, 33, 34 and 35, and the operator then selectes the required lower left-hand 
sub-quadrant 34 by operating the lower left-hand microswitch 19 as a third key stroke, giving the screen 
appearance shown in Figure 8. 
Once the required character has been selected by three key strokes in this manner, the program may be so 

25 arranged as to effect automatic printing of the selected character to the screen at another location and/or to a 
printer. Alternatively, a further operation of the tongue switch may be required to effect the actual printing to 
the screen and/or printer, for example operation of any two microswitches simultaneously. 

The above arrangement is by way of example only and it will be appreciated that the principle can be 
extended to cover any suitable number and arrangement of microswitches and any suitable number and 

30 arrangement of items of information on the screen, the only requirement being that, in order to facilitate 
selection of particular sub-arrays on the screen, the configuration of the sub-arrays corresponds in some 
manner to the positioning of the microswitches^ . 

The method can be expressed as a general formula for selecting a single option from n options using s 
switches, n and s are usually related by the formula n = s* where p is a positive integer. Thus, if four switches 

35 or combinations of switches are being used, the display may contain 4 P items to begin with. At each key 
stroke p is reduced by one until it reaches zero at which point a single option has been chosen. 

Thus in the above described example we started with a display containing 64 (- 4 3 ) options. After one key 
stroke we are left with 1 6 ( = 4 2 ) options; after two key strokes, four ( - 4 1 ) options and after three key strokes 
there is one {= 4°} option remaining. Thus we can chose any one out of 64 items with only three key strokes. 

40 In general we can chose one out of n options with log s n key strokes, where s equals the number of switches. 
W In any arrangement according to the invention the switches are arranged to some particular spatial 
configuration or pattern and the visual display has a corresponding spatial layout. 

Thus where the tongue switch comprises two microswitches arranged side-by-side the display may 
comprise simply two items side-by-side, for example a left-hand panel indicating "yes" and a right-hand 

45 panel indicating "no". 

Again, in a simple arrangement four switches arranged in a square may select any one of four items 
correspondingly arranged in a square on the display. 

U? In a slightly more complex system a tongue switch incorporating four microswitches arranged as shown in 
Figure 4 may be arranged to select from 6 options arranged in two rows of three. In this case the four corner 
50 items of the display may be selected by actuating the corresponding one of the four appropnate 

microswitches. The upper centre of the six items is selected by operating the two upper microswitches 17 
and 18 simultaneously, and the lower centre item of the display is selected by operating the two lower 
microswitches 19 and 20 simultaneously. 

L-Jn any of the arrangements described above, each selected item may itself comprise a sub-array of a 
55 further two, four or six options, as the case may be, the particular item of the sub-array being selected m 
similar fashion by appropriate operation of the microswitches. It will be appreciated that any number of 
levels of selection may be provided. In some cases the number of possible options may be so great that they 
cannot all be initially displayed on the screen at the same time there is sufficient information on the screen to 
indicate in which portion of the screen the required item will eventually be found, the program may be so 
60 arranged that at each selection of a sub-array the portion of the screen selected is shown over the whole 
screen in greater detail to enable the next stage of selection to be made. 

U Although the rectilinear arrangement of switches and portions of the display is preferred as providing a 
readily observable correspondence between the positions of the switches and the elements of the display, it 
will be appreciated, that any other suitable pattern or configuration of the switches and elements of the 
65 display may be provided. 
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<r L^The following is, by way of example, a computer program written in BBC Basic suitable for controlling a 
visual display in the manner described in relation to Figures 4 to 8. It should be stressed that this is by way of 
example only, and the program may be readily modified according to variations in the number of switches 
and in the required presentation of the display. 



10 



15 



1 

170 
410 
420 
430 
450 
1000 
1020 
1040 
1060 
1999 



MODE4 
scrnsize- 40 
scrgap^ scrn size/2-5 
sp$=STRING$(scrgap+1 
DIM arr4$(8,8) 
PROCread4 
REPEAT 
PROCfourchop 
PRINTTAB(10,10);i$; 
UNTIL FALSE 
END 



) 

) Main program loop 
> 
) 



6000 
6005 

20 6010 
6015 
6025 
6032 
6035 

25 6036 
6040 
6050 
6055 
6060 

30 6062 
6065 



DEPROCfourchop (Select one of the characters from the 8 x 8 array (in 3 stages)). 

h base = 5 : vbase - hbase 

inc=2 

FORchop-1TO3 

PROCdraw4 

PROCswtches 

IF insw-1 hbase=hbase-inc:vbase=vbase+inc 
IF insw=2 hbase=hbase+inc:vbase=vbase+inc 
IFinsw=3 hbase hbase-inc:vbase=vbase-inc 
IF insw=4 hbase=hbase+inc:vbase=vbase-inc 
inc=inc/2 
NEXT chop 

iS=arr4$(hbase,vbase) 
ENDPROC 



6070 DEFPROCdraw4 ('draw4' draws the display in the general case but is too slow in the first instance 
when the 8 x 8 array is needed, hence use of 'frame4'. (See below)). 

PROCblank4 

IFchop=1 THEN PROCframe4: ENDPROC 



35 6075 
6080 
6085 
6090 
6095 

40 6100 
6105 
6110 
6115 
6120 

45 6125 
6130 
6135 



50 



6140 
6142 
6145 
6150 
6155 
6160 
55 6165 
6170 



inc2=inc*2 

FOR l%-hbase-inc2 TO hbase+inc2-1 

FOR J%=vbase-inc2 TO vbase+inc2-1 

IF !%>=hbase AND J%<vbase PROCinvcol 

IF l%>=hbase AND J%>=vbase PROCtrucol 

IF !%<hbase AND J%>=vbase PROCinvcol 

IF l%<hbase AND J%<vbase PROCtrucol 

PRINTTAB(l%+scrgap,J%);arr4$(l%,J%); 

NEXTJ% 

NEXTI% 

ENDPROC 

DEFPROCread4 (Read in contents of 8 x 8 array from DATA statement, see lines 6320 - 6355) 

RESTORE 6320 

FOR t%=1 TO 8 

READ t1$, t2$:t$=t1$+t2$ 

F0RJ%=1TO8 

arr4$(J%,l%)=MID$(t$,J%,1 ) 

NEXTJ%:NEXTI% 

ENDPROC 
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6175 DEFPROCframe4 (Draw initial array onto screen) 

6180 RESTORE 6320 

60 6185 PRINT TAB(0,0) 

6190 FOR 1=1 TO 4 

6195 PRINTsp$; 

6196 PROCinvcol 

6200 READ t1 $: PRI NT tl $; 

65 6205 PROCtrucol 
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6210 READ t2S: PRINT t2$ 

6220 NEXT I 

6225 FOR 1=1 TO 4 

6230 PRINT sp$; 
5 6240 READ t1$:PRINTt1$; 

6245 PROCinvco! 

6250 READ t2$:PRINTt2$ 

6252 PROCtrucol 

6255 NEXT I 
10 6258 PROCtrucol 

6260 ENDPROC 

6265 DEFPROCblank4 (Blank out array before drawing subdivision) 
6270 FOR 1=1 TO 8 

15 6275 PRINT TABO, l);sp$;" ■ 

6280 NEXT I 
6285 ENDPROC 

6290 DEFPROCtrucol (Normal video) 
20 6295 COLOUR128:COLOUR1 
6300 ENDPROC 

6305 DEFPROCinvcol (Inverse video) 
6310 COLOUR129:COLOURO 
25 6315 ENDPROC 



6320 DATA A % }*, ! $GH 

6325 DATA "I f ~L*,MN%P 

6330 DATA ?.T,U£W% 3Q 

30 6335 DATAY&01,234< 

6340 DATA abcd # efgh 

6345 DATA ijkl,mnop 

6350 DATA q rst,u vwx 

6355 . DATA yz56,789> 35 

35 9600 DEFPROCswtches (Read switches at (in this case) the BBC's analogue port. Set 'insw' equal to 1,2,3, 

or 4 according to which switch detected closed). 

9620 IF (ADVAUO) AND 3)=0 AND ADVAU 1 ) > 1 000 AND ADVAL(2)>1000 GOTO 9620 

9640 IF (ADVAUO) AND3)=1 THEN insw=1 

40 9660 IF (ADVAUO) AND 3)=2 THEN insw=2 

9680 IF ADVAL(1)<1000THEN insw=3 

9700 IF ADVAU2)<1 000 THEN insw=4 ^ rt 

9710 IF (ADVAUO) AND 3)<>0 OR ADVAU 1) 1000 OR ADVAL(2)<1000 GOTO 9710 

9720 ENDPROC 45 

45 ^Although the arrangement has been described using a tongue-operated switch of the kind shown in Figure 
4, it will be appreciated that any other form of switch suitable for use by persons of limited contro,lable 
mobility may be employed, for example a touch switch or a switch operated by the foot, hand or any other 
□art of the bodv Also the arrangement is not of course limited to use by persons having physical disability. 

50 There may be other reasons why a user has only limited controllable mobility; for example the pilot of an 
aircraft may have his major bodily movements entirely involved in controlling the aircraft, and in this case 
also a tongue-operated or other control may be suitable for a subsidiary purpose, such as changing a 

h6 Alth U o P ugh ^previously described the visual display may be in the form of a cathode ray screen, many 
55 physically handicapped people also have defective eyesight and in view of this an f^!^^^^. 
therefore be used. This could be done simply by having a transparent screen illuminated from behind by two 
different colours of lamp. The layout would be the same as used on the computer screen 

Because of the limited number of output lines from the computer a decoding circuit would be needed to 
decide which lamps were to be lit; and a suitable arrangement might be as shown in Figure 9. 

60 

CLAIMS 

1 An operator-controlled display system com prising a plurality of electrical switches, the actuating 
element of 3Eh grouped In a pattern so that the switches may be or ,n 

65 selected combinations, and an electrically actuated visual display controlled by said switches m such 65 
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aforesaid pattern. the P° s,t,on of switch or switches in the 

offnfol S Sn m s a o C rSr g ,^ 
switc hrthei te m .whenseLed, bei n^ir^ 

*eLoY£S 

in the main array, such that, o„ceT;r a Ch as b ^ 

selects an item in the selected sub-array in accordant S*22„ *k ton of one or more switches 
7. A system according to claim 6, wherein Z TusezuZ ^ e P 0 ^ t,onofthe sw'tch or switches operated. 

the visua. disp,ay in acco?daniw^ to contro. 

25 programmed to control operations other than thTJ™«J*?£~' • 1 " the m, crocomputer is also 

certain of said switches oJ commons thereof °" V ' SUa ' disp,ay upon °P era «°" °* 2B 

a-Vd^^ ?■ SWitch °- combination of switches is 

aforesaid arrays. * dependent on whlcn Parhcular item was previously selected from the 

^ymboftS 30 
35 oplL^S^ 

the control being dependent on the item prSslv se ec?ed tb^Z ^ T" °* sw,tches ' the nature of 35 

13. A system according to any of claims T to 12 £Z£!?^ °P erator ^ the visual display, 
a switch assembly comprising a ^ of electrical switches is provided by 

elementsthereof closely groupeS in a pattern 
40 assemblymaybesupportedeLrn^Hyof^ 

tongue from the mouth * he °P erator andthus operated by protrusion of the 
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